Methods, systems, and products for indexing scenes in digital media

ABSTRACT

Methods, systems, and products index digital scenes in digital media. A uniform resource locator is assigned to each different digital scene within the digital media. The uniform resource locator uniquely identifies a resource from which each different digital scene may be retrieved. Individual scenes may thus be retrieved, thus conserving bandwidth and memory.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No11/890,118 filed Aug. 3, 2007 and since issued as U.S. Pat. No.8,744,118 , and incorporated herein by reference in its entirety.

BACKGROUND

Exemplary embodiments generally relate to computers, to television, andto data processing and, more particularly, to data packets in televisionformats, to display of additional information, and to electronicshopping.

Product placement in movies, advertisements, and other media can beimproved. When a movie, for example, features a product or service,often times people would like to see the featured product or servicewithout seeing the movie. Excerpts showing the product in the context ofa well-known film could be particularly persuasive to potential users.Or, the movie might be offensive to some people or the price ofadmission is too great. Regardless, an advertiser would like to have thefeatured product or service available to as many people as possible,even to those people who have not seen the movie. If the featuredproduct or service was available to anyone, advertisers would benefitfrom increased exposure.

SUMMARY

The exemplary embodiments provide methods, systems, and products forindexing frames and/or scenes in digital media. Exemplary embodimentsassign a unique uniform resource locator to a frame or a scene withinthe digital media. The uniform resource locator uniquely identifies aresource from which the frame or scene may be retrieved. Once the sceneis defined, its associated uniform resource locator may then be used toretrieve the scene. Individual users may query for a particular scene'scorresponding uniform resource locator. When the query is received, thenthe corresponding digital scene is retrieved from the memory and sent,downloaded, or streamed to the requesting device. An individual scenemay thus be retrieved, without the need for downloading the entiredigital media (such as an entire digital movie). As later paragraphswill explain, the digital scenes may be used to promote objects withoutthe expense of producing separate advertisements.

More exemplary embodiments include a system for indexing digital media.The system includes means for storing the digital scene in memory andassigning a uniform resource locator to the digital scene. The uniformresource locator uniquely identifies a resource from which the digitalscene may be retrieved, and the uniform resource locator also uniquelyidentifies the digital scene from other scenes in the digital media.When a query is received for the uniform resource locator, then meansare included for retrieving the digital scene from the memory.

Other exemplary embodiments describe a computer program product forindexing digital media. The digital scene is stored in memory and auniform resource locator is assigned to the digital scene. The uniformresource locator uniquely identifies a resource from which the digitalscene may be retrieved, and the uniform resource locator also uniquelyidentifies the digital scene from other scenes in the digital media.When a query is received for the uniform resource locator, then thedigital scene is retrieved from the memory.

Other systems, methods, and/or computer program products according tothe exemplary embodiments will be or become apparent to one withordinary skill in the art upon review of the following drawings anddetailed description. It is intended that all such additional systems,methods, and/or computer program products be included within thisdescription, be within the scope of the claims, and be protected by theaccompanying claims.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

These and other features, aspects, and advantages of the exemplaryembodiments are better understood when the following DetailedDescription is read with reference to the accompanying drawings,wherein:

FIG. 1 is a simplified schematic illustrating the exemplary embodiments;

FIGS. 2 and 3 are schematics illustrating the tagging of scenes ofdigital media, according to exemplary embodiments;

FIG. 4 is a detailed schematic illustrating a scene access server and acontent database, according to more exemplary embodiments;

FIG. 5 is a schematic illustrating a process for retrieving scenes,according to more exemplary embodiments;

FIG. 6 is a schematic illustrating a scene index, according to moreexemplary embodiments;

FIG. 7 is another schematic illustrating another process for retrievingscenes, according to more exemplary embodiments;

FIG. 8 is a schematic further illustrating the scene index, according tomore exemplary embodiments;

FIG. 9 is a schematic illustrating another process for retrievingscenes, according to more exemplary embodiments;

FIG. 10 is another schematic further illustrating the scene index 58,according to more exemplary embodiments;

FIG. 11 is a schematic illustrating another environment in whichexemplary embodiments may be implemented;

FIG. 12 depicts other possible operating environments for additionalaspects of the exemplary embodiments; and

FIG. 13 is a flowchart illustrating a method of indexing a scene indigital media, according to still more exemplary embodiments.

DETAILED DESCRIPTION

The exemplary embodiments will now be described more fully hereinafterwith reference to the accompanying drawings. The exemplary embodimentsmay, however, be embodied in many different forms and should not beconstrued as limited to the embodiments set forth herein. Theseembodiments are provided so that this disclosure will be thorough andcomplete and will fully convey the exemplary embodiments to those ofordinary skill in the art. Moreover, all statements herein recitingembodiments, as well as specific examples thereof, are intended toencompass both structural and functional equivalents thereof.Additionally, it is intended that such equivalents include bothcurrently known equivalents as well as equivalents developed in thefuture (i.e., any elements developed that perform the same function,regardless of structure).

Thus, for example, it will be appreciated by those of ordinary skill inthe art that the diagrams, schematics, illustrations, and the likerepresent conceptual views or processes illustrating the exemplaryembodiments. The functions of the various elements shown in the figuresmay be provided through the use of dedicated hardware as well ashardware capable of executing associated software. Those of ordinaryskill in the art further understand that the exemplary hardware,software, processes, methods, and/or operating systems described hereinare for illustrative purposes and, thus, are not intended to be limitedto any particular named manufacturer.

As used herein, the singular forms “a,” “an,” and “the” are intended toinclude the plural forms as well, unless expressly stated otherwise. Itwill be further understood that the terms “includes,” “comprises,”“including,” and/or “comprising,” when used in this specification,specify the presence of stated features, integers, steps, operations,elements, and/or components, but do not preclude the presence oraddition of one or more other features, integers, steps, operations,elements, components, and/or groups thereof. It will be understood thatwhen an element is referred to as being “connected” or “coupled” toanother element, it can be directly connected or coupled to the otherelement or intervening elements may be present. Furthermore, “connected”or “coupled” as used herein may include wirelessly connected or coupled.As used herein, the term “and/or” includes any and all combinations ofone or more of the associated listed items.

It will also be understood that, although the terms first, second, etc.may be used herein to describe various elements, these elements shouldnot be limited by these terms. These terms are only used to distinguishone element from another. For example, a first device could be termed asecond device, and, similarly, a second device could be termed a firstdevice without departing from the teachings of the disclosure.

FIG. 1 is a simplified schematic illustrating the exemplary embodiments.FIG. 1 illustrates how a user may download individual scenes of digitalmedia, such as movies, programs, and games. That is, the user may onlyretrieve an individual scene without the need for retrieving the entiremovie, program, or game. A user's device 20 communicates with a sceneaccess server 22 via a communications network 24. The scene accessserver 22 communicates with a content database 26. The content database26 stores one or more individual scenes 28 of digital media which may beaccessed by the user's device 20. Each scene 28 is accessed using anassociated link 30, such as a uniform resource locator (“URL”) 32. Thatis, each scene 28 may have a corresponding uniform resource locator 32.Each uniform resource locator 32 uniquely identifies the resource fromwhich the associated scene 28 may be retrieved. When the user, at theuser's device 20, wishes to access or retrieve a particular scene 28from some digital media, the user's device 20 queries the scene accessserver 22 using the scene's corresponding uniform resource locator 32.The user's device 20 sends a query 34, and the query 34 includesinformation representing the scene's corresponding uniform resourcelocator 32. The scene access server 22 queries the content database 26for the scene's corresponding uniform resource locator 32 and retrievesthe desired scene 28. The scene access server 22 then communicates thescene 28 to the user's device 20 (such as by download, session, orstreaming technique). The user, at the user's device 20, may then listento, view, or otherwise enjoy the individual scene 28, without accessingthe entire digital media file. Exemplary embodiments, then, describe howindividual scenes (or even individual frames) of digital media may beaccessed. Later paragraphs will also explain how billing may be arrangedfor retrieval of the desired scene 28.

Exemplary embodiments may be applied regardless of networkingenvironment. The communications network 24 may be a cable networkoperating in the radio-frequency domain and/or the Internet Protocol(IP) domain. The communications network 24, however, may also include adistributed computing network, such as the Internet (sometimesalternatively known as the “World Wide Web”), an intranet, a local-areanetwork (LAN), and/or a wide-area network (WAN). The communicationsnetwork 24 may include coaxial cables, copper wires, fiber optic lines,and/or hybrid-coaxial lines. The communications network 24 may eveninclude wireless portions utilizing any portion of the electromagneticspectrum and any signaling standard (such as the I.E.E.E. 802 family ofstandards, GSM/CDMA/TDMA or any cellular standard, and/or the ISM band).The concepts described herein may be applied to any wireless/wirelinecommunications network, regardless of physical componentry, physicalconfiguration, or communications standard(s).

FIGS. 2 and 3 are schematics illustrating the tagging of scenes ofdigital media, according to exemplary embodiments. FIG. 2 is a flowchartillustrating a method of tagging scenes, while FIG. 3 illustrates atagging server 38 that may perform the method of FIG. 2. Before theindividual scene (illustrated as reference numeral 28 in FIG. 1) may beretrieved, the scene 28 may need to be defined or designated. FIG. 2,then, illustrates how an arbitrary audio/video scene 28 within anydigital media (such as a movie, program, or game) is tagged. There are,however, many known schemes for tagging scenes, so FIG. 2 only presentsa generalized method for tagging scenes of digital media. When thedigital media is produced (Block 40), one or more scenes are defined(Block 42). The reader should realize that the term “scene” or “scenes”may encompass arbitrary designations of scenes. That is, the scene 28need not correspond to a traditional “scene” in the theatrical orcinematographic sense. Individual scenes, instead, may be defined withany specific starting and ending points. Any individual frame, orsequence of frames, may be labeled as a scene using any starting andending frame, time, or other designation. Scenes may be arbitrarilydefined to prove context. Regardless, once the scenes are defined, eachscene is then tagged or associated with a scene tag (Block 44). Once thescenes are tagged, a scene index may be generated (Block 46). The sceneindex may associate each scene to its corresponding scene tag. Thetagged scene may then be (although not necessarily) separately stored inthe content database 26 (Block 48).

Any means of defining and tagging a scene may be used. An individualscene, for example, may be defined by a timing measurement, such as anoffset time and a duration. Suppose, for example, that a sequence offrames in a movie promotes a fashion designer's clothing. That is, thefashion designer has negotiated to have her/his clothing featured in amovie. The scene that promotes this clothing (e.g., the promoted object)may be defined to begin at 0:14:39 from a start of the digital media andlasts for a duration of 0:00:30. The scene, in other words, is thirty(30) seconds in duration. A scene may additionally or alternatively bedefined by a starting frame number and by a range or number ofsuccessive, contiguous frames. Scenes may also be defined in a paralleltrack synchronized with the digital media, as is sometimes done foralternate languages or subtitles. Regardless, exemplary embodimentspermit definition of arbitrary scenes for any purpose. Again, though,because tagging of scenes is known, no further explanation is needed.

The scene index is used to retrieve a desired scene. The scene index maybe a logical relationship between scene tags and their correspondingoffset time and a duration. That is, when a request is received for ascene tag, the content database 26 accesses the digital media (e.g., amovie) and “jumps” or advances to the corresponding offset time and aduration. The content database 26, then, may quickly retrieve anddeliver the desired scene that corresponds to the scene tag. Scenes,then, may be defined and accessed from the digital media on a randomaccess basis. Individual scenes, however, may additionally oralternatively be stored separately from the corresponding digital media.That is, the content database 26 may individually store each sceneseparate from the corresponding movie.

FIG. 3, then, illustrates the tagging server 38. The tagging server 38may perform the method illustrated in FIG. 2. The tagging server 38accesses and retrieves the scene 28 stored in the content database 26.The content database 26 is illustrated as being remotely accessible tothe tagging server 38 (via the communications network 24 illustrated inFIG. 1), yet the content database 26 may be locally stored in memory 50of the tagging server 38. The tagging server 38 has a processor 52(e.g., “μP”), application specific integrated circuit (ASIC), or othersimilar device that executes a tagging application 54 stored in thememory 50. The tagging application 54 is a set of processor-executableinstructions that tags and/or indexes the scenes 28. The contentdatabase 26 may then store the tagged and scene-indexed digital media.

The tagging application 54 tags the scenes 28. As the above paragraphsexplained, any means of defining and of tagging the scene 28 may beused. However the scene 28 is defined and tagged, each digital scene 28may be associated, or tagged, with a scene tag 56. The scene tag 56 maybe any alphanumeric information or combination that uniquely identifiesthe digital scene 28. The scene tag 56 may differentiate one digitalscene from other frames and/or from other scenes 28.

The tagging application 54 may then generate a scene index 58. The sceneindex 58 lists each digital scene 28 and its corresponding scene tag 56.FIG. 3, for example, illustrates the scene index 58 as a table 60 thatmaps, relates, or otherwise associates the digital scenes 28 to thescene tags 56. The scene index 58, for example, may also associate eachdigital scene 28 to its corresponding starting and ending point (such asthe offset time and duration, illustrated as reference numeral 62). Thetagging application 54 may then store the scene index 58 in a database64 of indexes. The database 64 of indexes is illustrated as beingremotely accessible to the tagging server 38 (via the communicationsnetwork 24 illustrated in FIG. 1), yet the database 64 of indexes may belocally stored in the memory 50 of the tagging server 38. The sceneindex 58 may then be distributed to users, thus allowing users toretrieve desired scenes of digital media.

FIG. 4 is a detailed schematic illustrating the scene access server 22and the content database 26, according to more exemplary embodiments.Once the scene 28 is tagged and indexed, the scene access server 22retrieves and provides the scene 28 to users (such as the user's device20). In simple terms, when the user's device 20 queries the scene accessserver 22 for the scene 28, the scene access server 22 may access andretrieve the scene 28 from the content database 26. The content database26 is illustrated as being locally stored in memory 70 of the sceneaccess server 22, yet the content database 26 may be remotely accessiblevia the communications network (illustrated as reference numeral 24 inFIG. 1). The scene access server 22 has a processor 72 (e.g., “μP”),application specific integrated circuit (ASIC), or other similar devicethat executes a scene access application 74 stored in the memory 70. Thescene access application 74 may be a set of processor-executableinstructions that accesses the scene 28, according to exemplaryembodiments.

FIG. 5 is a schematic illustrating a process for retrieving scenes,according to more exemplary embodiments. Once the scene index 58 isgenerated, the scene access application 74 may send the scene index 58to the user's device 20 (Block 90). The scene index 58 informs the userof what digital scenes 28 are retrievable from the scene access server22 and/or the content database 26. Should the user wish to retrieve aparticular scene 28, the user's device 20 may send a query to the sceneaccess server 22 (Block 92). The query may include the scene tag 56 thatcorresponds to the desired scene 28. When the scene access server 22receives the query, the scene access application 74 reads or otherwiseobtains the scene tag 56 (Block 94). The scene access application 74 maythen query the content database 26 for the scene tag 56 (Block 96). Thecorresponding digital scene 28 is retrieved from the content database 26(Block 98), and the scene access application 74 arranges or initiates adownload, file transfer, session, or other communication with the user'sdevice 20 (Block 100). The scene access application 74 causes thedesired digital scene 28 to be communicated to the user's device 20.When the user's device 20 receives the desired scene 28, the user'sdevice 20 may then invoke a browser, MPEG decoder, or other applicationor hardware to view the scene 28. The user may thus enjoy the digitalscene 28 without being forced to receive or accept the entire digitalmedia file (e.g., an entire movie).

FIG. 6 is a schematic further illustrating the scene index 58, accordingto more exemplary embodiments. Here exemplary embodiments may enhancethe scene index 58 to associate the unique uniform resource locator 32to each scene 28. That is, exemplary embodiments may add, insert, orotherwise assign the uniform resource locator 32 to each digital scene28. The scene access application 74, for example, may associate theuniform resource locator 32 to each scene 28 in the scene index 58. Inother embodiments the tagging application (illustrated as referencenumeral 54 in FIG. 3) may add or associate the uniform resource locator32 to each scene 28 in the scene index 58. Regardless, the uniformresource locator 32 describes a server, server location, or otherresource from which the associated scene 28 may be retrieved. Should theuser's device 20 query for and receive the scene index 58 (as FIG. 5explained), the user is thus informed of the individual scenes 28 thatare available for download. Should the user query for a particularscene's uniform resource locator 32, the scene access application 74 mayaccess, retrieve, and initiate a download of the corresponding scene 28.

Here, then, each scene 28 may have a corresponding uniform resourcelocator 32. Each uniform resource locator 32 uniquely identifies theresource from which the associated scene 28 may be retrieved. When theuser wishes to access or retrieve a particular scene 28 from somedigital media, the user's device 20 need only query for the scene'scorresponding uniform resource locator 32. The scene access server 22queries the content database 26 for the scene's corresponding uniformresource locator 32 and retrieves the desired scene 28. The scene accessserver 22 then communicates the scene 28 to the user's device 20. Theuser may then enjoy the individual scene 28, without accessing theentire digital media file.

FIG. 7 is a schematic illustrating a detailed process for retrievingscenes, according to more exemplary embodiments. Here the uniformresource locator 32 may be translated into its corresponding scene tag56. The user's device 20 accesses a website or webpage associated with auniform resource locator 32 (Block 102). The uniform resource locator32, for example, may be associated with a link on a website thatpromotes a product (e.g., an automobile). When the user wishes toretrieve a particular scene 28, the user's device 20 may send a requestto the scene access server 22 using the uniform resource locator 32(Block 104). An Internet service provider's domain name server, forexample, may translate the uniform resource locator 32 to a networkaddress associated with the scene access server 22 (such as a SceneAccess Complex Internet Address). The scene access server 22 maytranslate the uniform resource locator 32 to a corresponding scene tag56 (Block 106). The scene access server 22 may query the contentdatabase 26 for the scene tag 56 (Block 108). The scene access server 22retrieves the digital scene 28 associated with the scene tag 56 (Block110). The scene access server 22 sends the digital scene 28 to therequesting device (e.g., the user's device 20) (Block 112).

Exemplary embodiments may even include billing schemes. When the user'sdevice 20 retrieves or receives the digital scene 28, some entity may becharged for the scene 28. The indexing application 36, for example, mayinclude a billing component or module. The indexing application 36 maythen charge or impose a fee for the scene 28. An advertiser, forexample, may be charged a fee each time a user accesses a scene. Theuser, associated with the user's device 20, may additionally oralternatively be charged for the scene. The user's device 20, forexample, may be associated with a billing profile, such that a creditcard is charged or an account is debited. The indexing application 36may even implement a subscription plan that regularly provides scenesfor a fee.

FIG. 8 is a schematic further illustrating the scene index 58, accordingto more exemplary embodiments. As earlier paragraphs mentioned,exemplary embodiments may be applied to advertisements that promoteobjects. That is, exemplary embodiments may be used to index and accessscenes that promote any product or service which is placed in a move,program, game, or other digital media. The digital media may be anymovie, video, advertisement, website, or other content. The promotedobject may be a person (such as a celebrity), a consumer good, aninvestment service, or any other object of interest. Suppose, forexample, an automotive manufacturer places its new vehicle in a majormotion picture. The manufacturer would like to advertise the picture'sstarring actor driving the manufacturer's new vehicle. The manufacturercould, conventionally, pay for a separate commercial that features theactor and the new vehicle. Exemplary embodiments, however, permit themanufacturer to define and access the particular scene 28 from themotion picture that features the actor and the new vehicle. The scene 28may be available from (or stored in) the content database 26, and themanufacturer may include a link (e.g., the uniform resource locator 32)on its website. When the uniform resource locator 32 is selected, thescene access server 22 is queried for the corresponding digital scene28. There is no need to separately produce a commercial. Similarly, thescene access server 22 may provide uniform resource locator links toscenes of a celebrity drinking a COKE® product, some person checkinginto a MARRIOTT® hotel, and/or an attractive person wearing the latestTOMMY HILFIGER® shirt. The digital scenes 28 available from and/orstored in the scene access server 22 may be accessed and quicklyformatted for other online advertising, for television/cable broadcasts,and for Internet Protocol television service. Exemplary embodiments,then, generate a much less costly advertising alternative to separatelyfilmed commercials.

FIG. 8, then, illustrates the scene index 58. Here the scene index 58again lists each digital scene 28, its corresponding scene tag 56, andits corresponding uniform resource locator 32. Here, however, the sceneindex 58 may also map, relate, or otherwise associate each scene 28 to apromoted object 116. Each scene tag 56 may uniquely identify individualframes or scenes in which the promoted object 116 appears. The sceneaccess application 74 may have logic or programming that recognizes thepromoted object 116 within the frame or scene. The scene accessapplication 74, additionally or alternatively, may retrieve a listing118 of the scenes or frames in which each object 116 appears.Regardless, the scene access application 74 may access each scene 28 inwhich the object 116 appears or into which the object 116 isincorporated.

The scene access application 74 accesses the scene index 58. The sceneindex 58 may list each scene 28 in which the object 116 appears and/oreach corresponding scene tag 56. FIG. 8, for example, illustrates thescene index 58 as the table 60 that maps, relates, or otherwiseassociates the scene tag 56 to the promoted object 116. While the sceneindex 58 may be associated with only a single promoted object, in FIG. 8the scene index 58 is organized according to multiple promoted objects116. Many movies, for example, contain several, if not many, productplacements. The scene index 58, then, lists each promoted object 116 andeach scene 28 in which that promoted object 116 appears. The scene index58 may also list each scene's corresponding scene tag 56.

The database 64 of indexes may store one or multiple scene indexes. Eachscene index 58 may correspond to a different promoted object 116. Onescene index 58, for example, may map, relate, or otherwise associateCOCA-COLA® products to movies, games, and other digital media. In otherwords, the scene index may associate COCA-COLA® products to multiplemovies that promote those objects. Likewise, another scene index 58 mayassociate GENERAL MOTORS® to some or all movies and games that promoteGM® vehicles. Similarly, the scene index 58 may only associate scenesand/or products in a single movie. The scene index 58, for example, maycorrespond to THE THOMAS CROWN AFFAIR® and only associate scenes and/orproducts in that movie. The scene index 58, however, may also correspondto a multiple media, such as the JAMES BOND® family of movies, atelevision series, or any grouping of media products. Regardless, thedatabase 64 of indexes may store many scene indexes 68, with one or moreof the scene indexes 68 associated with a particular digital mediaproduct and/or a promoted object.

FIG. 9 is a schematic illustrating another process for retrievingscenes, according to more exemplary embodiments. Here the database 64 ofindexes may be queried for the promoted objects 116. When the userwishes to retrieve an index of promoted objects for a particular digitalmedia, the user's device 20 sends a query (Block 120). FIG. 9illustrates the query arriving at the database 64 of indexes. That is,the query may be directly sent from the user's device 20 to the database64 of indexes, or the query may be sent to the scene access server 22and then forwarded to the database 64 of indexes. The query may includemedia information 122 that identifies the digital media. The mediainformation 122, for example, may be a title of a movie, programepisode, or game. The query may additionally or alternatively includeobject information 124 that identifies the promoted object. The objectinformation 124 may a name or text associated with the promoted object116. The object information 124, for example, may be a brand name, suchas “Coke” or “General Motors.” The object information 124, however, maybe a generic descriptor, such as “soft drink” or “automobile.” When thedatabase 64 of indexes receives the query, the database 64 of indexesretrieves the scene index 58 associated with the media information 122and/or the object information 124 (Block 126). The database 64 ofindexes, for example, may retrieve the scene index 58 associated withthe media information 122 (e.g., the title of a movie). The database 64of indexes may retrieve one or more of the scene indexes 68 that areassociated with the object information 124. Suppose, for example, thatthe object information 124 describes a ROLEX® watch. The database 64 ofindexes may then retrieve a listing of all the scene indexes 68 that areassociated with a ROLEX® watch. Regardless, the database 64 of indexessends a query response (Block 128), and the query response includes theone or more scene indexes 58 associated with, or matching, the mediainformation 122 and/or the object information 124. When the user'sdevice 20 receives the query response, the user's device 20 may cause avisual and/or audible presentation of the scene indexes 68. The user isthus informed of products and/or services promoted in digital media.

Once the scene index 58 is obtained, individual scenes may be retrieved.Because the scene index 58 may associate the uniform resource locator 32to each scene 28, each scene's corresponding uniform resource locator 32may be used to obtain the desired scene 28. The interactive, uniformresource locator 32 may describe a resource (such as a server or serverlocation) from which the associated scene 28 may be stored and/ordownloaded. When the user's device 20 queries the database 64 of indexesfor the media information 122 and/or the object information 124, theretrieved scene index 58 may also include the uniform resource locator32 associated with each scene 28 in which the promoted object 116appears. When the user's device 20 receives the scene index 58, the useris thus informed of products promoted in a particular digital media.Should the user select a uniform resource locator 32 (Block 130), theuser's selection may initiate a query to the corresponding resource forthe scene 28 associated with the uniform resource locator 32. The user'sdevice 20 may thus initiate a download of the corresponding scene(s) 28.The user's selection may also initiate a download or query forinteractive information regarding the promoted object 116.

Suppose, for example, the scene index 58 provides an index of objectspromoted in THE THOMAS CROWN AFFAIR®. When one of the promoted objectsis a ROLEX® watch, the scene index 58 may list each scene 28 in whichthe ROLEX® watch appears. The scene index 58 may (or may not) list eachcorresponding scene tag 56. The scene index 58 may (or may not) list aframe number, time, or starting point at which the ROLEX® watch appears(perhaps measured from the start or beginning of the digital media). Thescene index 58 preferably also lists the uniform resource locator 32 foreach scene 28 in which the promoted object 116 appears. When the user'sdevice 20 receives the scene index 58, the user may select the desiredlink 30 to initiate a fetch or download of the corresponding scene(s)28. The user's device 20 may thus receive the scene 28 in which theROLEX® watch appears. Security measures may also be implemented toensure the user is legitimately requesting the scene 28 (e.g., clickingon a link on the product manufacturer's website) and not merelyattempting to obtain a sneak preview of a movie.

The user may also receive information regarding the promoted object 116.When the user selects the desired uniform resource locator 32, theuser's device 20 may also query for, or receive, information regardingthe promoted object 116. When the user's device 20 receives the scene 28in which the ROLEX® watch appears, the user's device 20 may also queryfor and/or receive promotional information regarding the ROLEX® watch.The user's device 20, for example, may also query for and receivepricing and vendor information, such as where the ROLEX® watch may bepurchased and for what price. Exemplary embodiments may cause a visualand/or audible presentation of information regarding the promoted object116. Exemplary embodiments may cause or present interactive links (e.g.,uniform resource locators) from which the information may be retrieved.

Many schemes for obtaining product information, pricing, and vendors areknown and, thus, not further discussed. If the reader desires moredetails, the reader is invited to consult the following sources: U.S.Pat. No. 5,590,262 to Isadore-Barreca; U.S. Pat. No. 5,708,845 toWistendahl, et al.; U.S. Pat. No. 6,426,778 to Valdez; U.S. Pat. No.6,570,587 to Efrat, et al.; U.S. Pat. No. 7,158,676 to Rainsford; U.S.Patent Application Publication 2002/0075332 to Geilfuss, et al.; U.S.Patent Application Publication 2004/0019524 to Marshall; U.S. PatentApplication Publication 2004/0193441 to Alfieri; U.S. Patent ApplicationPublication 20050220439 to Carton, et al.; U.S. Patent ApplicationPublication 2006/0020523 to Song; U.S. Patent Application Publication2006/0120689 to Baxter; U.S. Patent Application Publication 20060230123to Simmons, et al.; U.S. Patent Application Publication 2007/0078774 toBrown; and U.S. Patent Application Publication 2007/0089158 to Clark.

FIG. 10 is another schematic further illustrating the scene index 58,according to more exemplary embodiments. Here the scene index 58 may beadded to, or inserted into, its corresponding digital media 140. Thescene index 58 corresponding to THE THOMAS CROWN AFFAIR®, for example,may be added to the digital movie. At any point or time during THETHOMAS CROWN AFFAIR®, the user may retrieve or view the scene index 58.FIG. 10, for example, illustrates a menu 142 of contents for the digitalmedia 140. The menu 142 of contents is commonly available in mostmovies, games, and other digital media. The menu 142 of contents allowsthe user to scroll and select individual scenes or chapters within thedigital media. FIG. 10, then, illustrates that exemplary embodiments maycause the scene index 58 to be inserted into, or associated with, themenu 142 of contents. The scene index 58 thus allows the user to “jump”or advance to a particular point or frame in which a desired object 116is promoted. The user may thus view/listen to the scene 28 in which thepromoted object 116 occurs. The user may also obtain productinformation, pricing information, and vendor information for thepromoted product.

Exemplary embodiments may even add a scene index tag 144 to the sceneindex 58. The scene index tag 144 uniquely identifies a point within thedigital media 140 at which the scene index 58 is placed or occurs. Theindexing application 36, for example, may create, associate, or assign anew scene or chapter to the scene index 58. Exemplary embodiments maythen tag the scene index 58 with the scene index tag 144. The sceneindex tag 144 may differentiate the scene index 58 from other scenes orother chapters within the digital media 140. When the digital media 140is searched by scene or by chapter, the scene index 58 may then beeasily accessed. At any point or time during THE THOMAS CROWN AFFAIR®,for example, the user may retrieve or view the scene index 58 and skipto a particular scene or frame in which a desired object is promoted.The user may also obtain product information, pricing information, andvendor information for the promoted object.

Other schemes may be used to add the scene index 58 to the digital media140. The scene index 58, for example, may be added to one or more blankframes within the digital media 140. Exemplary embodiments may create,insert, or process at least one blank frame into the beginning, middle,end, or any other location in the digital media 140. Exemplaryembodiments may then insert or copy the scene index 58 into the at leastone blank frame. Exemplary embodiments, for example, may create theblank frame in or near a beginning of THE THOMAS CROWN AFFAIR®.Exemplary embodiments may then place, add, or insert the correspondingscene index 58 into the blank frame. Exemplary embodiments thus augmentthe digital media 140 with its corresponding scene index 58.

FIG. 11 is a schematic illustrating another environment in whichexemplary embodiments may be implemented. Here the scene access server22 may act as a content server and respond to requests for digitalscenes 28. The scene access server 22 may be queried for scenes 28 orfor frames containing the promoted object 116. As FIG. 11 illustrates,the scene access server 22 receives a request 150 (via thecommunications network 24 illustrated in FIG. 1). The request 150 mayoriginate from any party or device, such as the user's device 20 or anadvertiser's server 152. When an advertiser wishes to retrieve scenesthat feature the promoted object 116, the request 150 may include theuniform resource locator 32 associated with the digital scene 28 inwhich the promoted object 116 appears. The request 150 may additionallyor alternatively include the scene tag 56, the media information 122,and/or the object information 124.

Here, then, the scene access server 22 acts as a central content serverthat accesses and/or stores individual scenes 28 (or “clips”) of digitalmedia. That is, the scene access server 22 may store or access scenesfor multiple, if not many, digital media files. When an advertiserdesires to retrieve an individual scene 28 that promotes the object 116,the advertiser's server 152 queries the scene access server 22. Thescene access application 74 then queries the content database 26 and/orthe database 64 of indexes for the scene 28 that corresponds to theuniform resource locator 32, scene tag 56, the media information 122,and/or the object information 124. The scene access application 74retrieves the desired scene 28 and sends a response 154. The responsemay include the advertiser's desired scene 28. When the advertiser'sserver 152 receives the response 154, the digital scene 28 may be usedin any advertising media to promote the object 116. The scene 28,additionally or alternatively, may be directly sent to the user's device20 or forwarded from the advertiser's server 152 to the user's device20.

Exemplary embodiments may also charge for the scene 28. As the aboveparagraphs explained, exemplary embodiments may include a billingcomponent or module. Exemplary embodiments may then charge or impose afee each time the scene 28 is retrieved. Here, though, exemplaryembodiments may charge an advertiser associated with the scene 28. Thatis, each time the scene 28 is retrieved, the advertiser is charged. Thescene access application 74, for example, may include a logical counterthat counts or tallies the number of queries (or “hits”) received forthe scene 28 and/or the uniform resource locator 32. The advertiser maythen be charged, based on the number of queries or “hits.” Securitymeasures may also be implemented to ensure only legitimate advertisershave access to the scene 28, thus thwarting attempts to sneak a previewof a movie.

FIG. 12 depicts other possible operating environments for additionalaspects of the exemplary embodiments. FIG. 12 illustrates that thetagging application 54 and/or the scene access application 74 mayalternatively or additionally operate within various other devices 400.FIG. 12, for example, illustrates that the tagging application 54 and/orthe scene access application 74 may entirely or partially operate withina set-top box (402), a personal/digital video recorder (PVR/DVR) 404,personal digital assistant (PDA) 406, a Global Positioning System (GPS)device 408, an interactive television 410, an Internet Protocol (IP)phone 412, a video-enabled phone 414 (such as an APPLE® iPhone™), acellular/satellite phone 416, or any computer system and/orcommunications device utilizing a digital processor and/or a digitalsignal processor (DP/DSP) 418. The device 400 may also include watches,radios, vehicle electronics, clocks, printers, gateways, and otherapparatuses and systems. Because the architecture and operatingprinciples of the various devices 400 are well known, the hardware andsoftware componentry of the various devices 400 are not further shownand described. If, however, the reader desires more details, the readeris invited to consult the following sources: ANDREW TANENBAUM, COMPUTERNETWORKS (4^(th) edition 2003); WILLIAM STALLINGS, COMPUTER ORGANIZATIONAND ARCHITECTURE: DESIGNING FOR PERFORMANCE (7^(th) Ed., 2005); andDAVID A. PATTERSON & JOHN L. HENNESSY, COMPUTER ORGANIZATION AND DESIGN:THE HARDWARE/SOFTWARE INTERFACE (3^(rd). Edition 2004); LAWRENCE HARTEet al., GSM SUPERPHONES (1999); SIEGMUND REDL et al., GSM AND PERSONALCOMMUNICATIONS HANDBOOK (1998); and JOACHIM TISAL, GSM CELLULAR RADIOTELEPHONY (1997); the GSM Standard 2.17, formally known SubscriberIdentity Modules, Functional Characteristics (GSM 02.17 V3.2.0(1995-01))”; the GSM Standard 11.11, formally known as Specification ofthe Subscriber Identity Module—Mobile Equipment (Subscriber IdentityModule—ME) interface (GSM 11.11 V5.3.0 (1996-07))”; MICHEAL ROBIN &MICHEL POULIN, DIGITAL TELEVISION FUNDAMENTALS (2000); JERRY WHITAKERAND BLAIR BENSON, VIDEO AND TELEVISION ENGINEERING (2003); JERRYWHITAKER, DTV HANDBOOK (2001); JERRY WHITAKER, DTV: THE REVOLUTION INELECTRONIC IMAGING (1998); and EDWARD M. SCHWALB, ITV HANDBOOK:TECHNOLOGIES AND STANDARDS (2004).

FIG. 13 is a flowchart illustrating a method of indexing a scene indigital media, according to still more exemplary embodiments. Framescontaining an object of interest (e.g., containing a product, service,person, place, or thing) are identified (Block 500). A digital scene maybe defined as an offset time and a duration for the frames (Block 502).A tag is assigned to the scene (Block 504). A table scenes, tags,offsets, and durations is created (Block 506). The table is stored with(or separate from) the digital content (Block 508). A uniform resourcelocator is assigned to the tag (Block 510). A scene index may begenerated that lists the uniform resource locator associated with thescene tag (Block 512). When a query is received for the uniform resourcelocator, the uniform resource locator is translated to the correspondingscene tag (Block 514). The scene, associated with the tag, is retrievedand delivered (Block 516).

Exemplary embodiments may be physically embodied on or in acomputer-readable medium. This computer-readable medium may includeCD-ROM, DVD, tape, cassette, floppy disk, memory card, andlarge-capacity disk (such as IOMEGA®, ZIP®, JAZZ®, and otherlarge-capacity memory products (IOMEGA®, ZIP®, and JAZZ® are registeredtrademarks of Iomega Corporation, 1821 W. Iomega Way, Roy, Utah 84067,801.332.1000, www.iomega.com). This computer-readable medium, or media,could be distributed to end-subscribers, licensees, and assignees. Thesetypes of computer-readable media, and other types not mention here butconsidered within the scope of the exemplary embodiments. A computerprogram product comprises processor-executable instructions for tagging,indexing, and/or accessing scenes in digital media.

While the exemplary embodiments have been described with respect tovarious features, aspects, and embodiments, those skilled and unskilledin the art will recognize the exemplary embodiments are not so limited.Other variations, modifications, and alternative embodiments may be madewithout departing from the spirit and scope of the exemplaryembodiments.

The invention claimed is:
 1. A method, comprising: receiving, by aserver, an electronic query from a client device, the electronic queryrequesting digital media, and the electronic query specifyinginformation associated with a title of the digital media; querying, bythe server, an electronic database for the information associated withthe title of the digital media, the electronic database electronicallyassociating scene indexes and titles including the informationassociated with the title of the digital media; retrieving, by theserver, a scene index of the scene indexes in the electronic databasethat is electronically associated with the information associated withthe title of the digital media, the scene index associating promotionalobjects appearing in the digital media to scenes within the digitalmedia; retrieving, by the server, the digital media having a menu ofcontents; inserting, by the server, a blank frame into the digitalmedia; copying, by the server, the scene index into the blank frame;adding, by the server, the scene index to the menu of contents; andsending, by the server, the digital media to the client device, thedigital media having the scene index added to the menu of contents. 2.The method of claim 1, further comprising associating a uniform resourcelocator to the scene index.
 3. The method of claim 1, further comprisingassociating different uniform resource locators to different scenesassociated with the digital media.
 4. The method of claim 1, furthercomprising receiving a request for the scene index associated with thedigital media.
 5. The method of claim 4, further comprising adding anentry to the scene index describing at least one of the promotionalobjects.
 6. A system, comprising: a hardware processor; and a memorydevice, the memory device storing instructions, the instructions whenexecuted causing the hardware processor to perform operations, theoperations comprising: receiving an electronic query from a clientdevice, the electronic query requesting digital media, and theelectronic query specifying information associated with a title of thedigital media; querying an electronic database for the informationassociated with the title of the digital media, the electronic databaseelectronically associating scene indexes and titles including theinformation associated with the title of the digital media; retrieving ascene index of the scene indexes in the electronic database that iselectronically associated with the information associated with the titleof the digital media, the scene index associating promotional objectsappearing in the digital media to scenes within the digital media;retrieving the digital media having a menu of contents; inserting ablank frame into the digital media; copying the scene index into theblank frame; adding the scene index to the menu of contents; and sendingthe digital media to the client device, the digital media having thescene index added to the menu of contents.
 7. The system of claim 6,wherein the operations further comprise associating a uniform resourcelocator to the scene index.
 8. The system of claim 6, wherein theoperations further comprise adding the scene index to an index of scenesassociated with the digital media.
 9. The system of claim 6, wherein theoperations further comprise associating different uniform resourcelocators to different scenes in the digital media.
 10. The system ofclaim 6, wherein the operations further comprise receiving a request forthe scene index associated with the digital media.
 11. The system ofclaim 10, wherein the operations further comprise adding an entry to thescene index describing at least one of the promotional objects.
 12. Anon-transitory processor-readable memory device storing instructionsthat when executed cause a hardware processor to perform operations, theoperations comprising: receiving an electronic query from a clientdevice, the electronic query requesting digital media, and theelectronic query specifying information associated with a title of thedigital media; querying an electronic database for the informationassociated with the title of the digital media, the electronic databaseelectronically associating scene indexes and titles including theinformation associated with the title of the digital media; retrieving ascene index of the scene indexes in the electronic database that iselectronically associated with the information associated with the titleof the digital media, the scene index associating promotional objectsappearing in the digital media to scenes within the digital media;retrieving the digital media having a menu of contents; inserting ablank frame into the digital media; copying the scene index into theblank frame inserted into the digital media; assigning a new scene tothe scene index copied into the blank frame inserted into the digitalmedia; adding the scene index to the menu of contents; and sending thedigital media to the client device, the digital media having the sceneindex added to the menu of contents.
 13. The non-transitoryprocessor-readable memory device of claim 12, wherein the operationsfurther comprise associating a uniform resource locator to the sceneindex.
 14. The non-transitory processor-readable memory device of claim12, wherein the operations further comprise adding the scene index to anindex of scenes associated with the digital media.
 15. Thenon-transitory processor-readable memory device of claim 12, wherein theoperations further comprise associating different uniform resourcelocators to different scenes in the digital media.
 16. Thenon-transitory processor-readable memory device of claim 12, wherein theoperations further comprise uniquely identifying the new scene with ascene index tag that differentiates the scene index from other scenes inthe digital media.
 17. The non-transitory processor-readable memorydevice of claim 12, wherein the operations further comprise: receiving arequest for the scene index; and adding an entry to the scene indexdescribing at least one of the promotional objects.